Skip to content

[Fix](nereids)Window agg grouping sets Bug Fix - #31603

Merged
morrySnow merged 3 commits into
apache:branch-2.0from
feiniaofeiafei:pick31475
Feb 29, 2024
Merged

[Fix](nereids)Window agg grouping sets Bug Fix#31603
morrySnow merged 3 commits into
apache:branch-2.0from
feiniaofeiafei:pick31475

Conversation

@feiniaofeiafei

@feiniaofeiafei feiniaofeiafei commented Feb 29, 2024

Copy link
Copy Markdown
Collaborator

pr #31475 pick to branch-2.0

@doris-robot

doris-robot commented Feb 29, 2024

Copy link
Copy Markdown

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

@morrySnow

morrySnow commented Feb 29, 2024

Copy link
Copy Markdown
Contributor

run buildall

@doris-robot

doris-robot commented Feb 29, 2024

Copy link
Copy Markdown
TPC-H: Total hot run time: 49945 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 754f87c1106c3e11e27e91fc85190aea03d74565, data reload: false

------ Round 1 ----------------------------------
q1	17537	4460	4335	4335
q2	2025	151	146	146
q3	10275	1877	1949	1877
q4	10111	1245	1321	1245
q5	8445	4002	3995	3995
q6	236	125	126	125
q7	2079	1609	1581	1581
q8	9313	2717	2725	2717
q9	11121	11340	10471	10471
q10	8606	3543	3472	3472
q11	416	242	245	242
q12	466	296	308	296
q13	18337	4025	4031	4025
q14	365	326	324	324
q15	511	462	461	461
q16	706	582	578	578
q17	1122	959	942	942
q18	7398	6807	6996	6807
q19	1681	1535	1483	1483
q20	518	327	297	297
q21	4436	4125	4180	4125
q22	496	408	401	401
Total cold run time: 116200 ms
Total hot run time: 49945 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4329	4353	4301	4301
q2	318	227	225	225
q3	4175	4136	4113	4113
q4	2752	2763	2765	2763
q5	7236	7212	7180	7180
q6	238	120	121	120
q7	3237	2861	2847	2847
q8	4414	4454	4523	4454
q9	17063	17085	17012	17012
q10	4209	4243	4271	4243
q11	760	670	673	670
q12	1005	872	838	838
q13	6889	3709	3742	3709
q14	452	442	417	417
q15	492	456	461	456
q16	760	704	701	701
q17	3815	3828	3905	3828
q18	8742	8811	8661	8661
q19	1708	1679	1683	1679
q20	2400	2154	2114	2114
q21	8607	8567	8491	8491
q22	1038	964	956	956
Total cold run time: 84639 ms
Total hot run time: 79778 ms

@doris-robot

doris-robot commented Feb 29, 2024

Copy link
Copy Markdown
TPC-DS: Total hot run time: 202785 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 754f87c1106c3e11e27e91fc85190aea03d74565, data reload: false

query1	939	397	380	380
query2	6530	2153	2039	2039
query3	6919	207	205	205
query4	20259	18119	18053	18053
query5	19713	6526	6551	6526
query6	296	216	232	216
query7	4150	296	306	296
query8	259	262	227	227
query9	3178	2734	2631	2631
query10	421	299	309	299
query11	11432	10774	10756	10756
query12	120	79	73	73
query13	5575	642	611	611
query14	18061	13605	13665	13605
query15	370	232	235	232
query16	6431	255	258	255
query17	1743	1453	865	865
query18	2323	399	409	399
query19	203	139	149	139
query20	77	77	74	74
query21	186	106	98	98
query22	5307	5232	5052	5052
query23	32604	32005	31989	31989
query24	6920	6539	6523	6523
query25	541	431	398	398
query26	532	165	166	165
query27	1884	296	297	296
query28	6047	2232	2199	2199
query29	2889	2789	2755	2755
query30	240	158	161	158
query31	889	735	733	733
query32	68	53	61	53
query33	384	260	244	244
query34	840	475	472	472
query35	1102	871	904	871
query36	1499	1410	1770	1410
query37	86	61	60	60
query38	3061	2918	2872	2872
query39	1373	1323	1325	1323
query40	203	102	107	102
query41	35	33	32	32
query42	85	89	82	82
query43	720	547	731	547
query44	1129	718	705	705
query45	241	229	226	226
query46	1234	944	980	944
query47	1760	1876	1875	1875
query48	974	692	668	668
query49	613	372	371	371
query50	880	589	610	589
query51	4808	4706	4702	4702
query52	91	85	73	73
query53	439	320	311	311
query54	2628	2464	2445	2445
query55	85	81	81	81
query56	232	210	198	198
query57	1132	1169	1122	1122
query58	211	205	201	201
query59	3577	3540	3309	3309
query60	200	183	209	183
query61	87	80	83	80
query62	859	496	491	491
query63	467	332	343	332
query64	2544	1545	1427	1427
query65	3637	3574	3559	3559
query66	804	363	395	363
query67	17910	15276	15678	15276
query68	8712	654	674	654
query69	577	315	328	315
query70	1980	1911	1818	1818
query71	418	307	299	299
query72	6415	3384	3404	3384
query73	742	333	312	312
query74	6359	5911	5853	5853
query75	5411	3729	3647	3647
query76	5401	1185	1218	1185
query77	898	250	246	246
query78	12433	11654	11653	11653
query79	8325	623	626	623
query80	1279	385	393	385
query81	488	230	239	230
query82	1665	91	93	91
query83	171	132	122	122
query84	246	67	67	67
query85	876	278	277	277
query86	399	368	372	368
query87	3213	2972	3010	2972
query88	5210	2357	2340	2340
query89	381	274	284	274
query90	1945	202	198	198
query91	154	114	113	113
query92	59	49	48	48
query93	5420	628	551	551
query94	694	209	211	209
query95	1083	1061	1045	1045
query96	647	329	324	324
query97	6539	6287	6457	6287
query98	179	168	169	168
query99	2901	881	892	881
Total cold run time: 314256 ms
Total hot run time: 202785 ms

@doris-robot

doris-robot commented Feb 29, 2024

Copy link
Copy Markdown
ClickBench: Total hot run time: 31.02 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 754f87c1106c3e11e27e91fc85190aea03d74565, data reload: false

query1	0.02	0.02	0.02
query2	0.07	0.03	0.02
query3	0.24	0.04	0.05
query4	1.80	0.07	0.06
query5	0.53	0.53	0.52
query6	1.24	0.62	0.62
query7	0.02	0.01	0.01
query8	0.04	0.03	0.02
query9	0.54	0.48	0.48
query10	0.53	0.52	0.54
query11	0.12	0.09	0.08
query12	0.11	0.09	0.09
query13	0.62	0.62	0.60
query14	0.80	0.79	0.81
query15	0.79	0.77	0.76
query16	0.37	0.37	0.36
query17	1.04	1.03	1.02
query18	0.22	0.25	0.25
query19	1.97	1.87	1.86
query20	0.02	0.01	0.01
query21	15.47	0.58	0.56
query22	2.00	2.10	1.94
query23	17.54	0.98	1.02
query24	4.65	1.48	0.90
query25	0.33	0.12	0.06
query26	0.60	0.12	0.14
query27	0.04	0.03	0.03
query28	8.17	0.82	0.76
query29	12.72	2.35	2.23
query30	0.60	0.54	0.52
query31	2.81	0.39	0.38
query32	3.39	0.49	0.48
query33	3.10	3.10	3.06
query34	15.29	4.78	4.79
query35	4.86	4.83	4.84
query36	1.07	1.02	1.02
query37	0.05	0.05	0.04
query38	0.04	0.02	0.02
query39	0.02	0.01	0.01
query40	0.16	0.14	0.14
query41	0.06	0.01	0.01
query42	0.02	0.01	0.01
query43	0.02	0.01	0.01
Total cold run time: 104.1 s
Total hot run time: 31.02 s

@doris-robot

doris-robot commented Feb 29, 2024

Copy link
Copy Markdown

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 754f87c1106c3e11e27e91fc85190aea03d74565 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       21.8 seconds inserted 10000000 Rows, about 458K ops/s

@morrySnow
morrySnow merged commit 6961056 into apache:branch-2.0 Feb 29, 2024
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
@feiniaofeiafei weixingyu12
[Fix](nereids) Window agg grouping sets Bug Fix (apache#31603)
92829c9 
pr apache#31475 pick to branch-2.0

Co-authored-by: feiniaofeiafei <moailing@selectdb.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

area/nereids kind/test

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@feiniaofeiafei @doris-robot @morrySnow